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1.  Introduction 


Let  X  and  Y  be  two  random  variables  with  cumulative 
distribution  functions  F(x)  and  G(y)  respectively. 

Suppose  Y  is  the  strength  of  a  component  subject  to  a  stress 
X  .  Then  the  component  fails  if  at  any  moment  the  applied 
stress  (or  load)  is  greater  than  its  strength.  The  stress  is 
a  function  of  the  environment  to  which  the  component  is 
subjected.  Strength  depends  on  material  properties,  manufacturing 
procedures,  and  so  on.  The  reliability  of  a  component  is  the 
probability  that  its  strength  exceeds  the  stress.  From  practical 
considerations  it  is  desirable  to  draw  inference  about  the 
reliability  function. 

The  above  model  was  first  considered  by  Bimbaum  (1956) 
and  has  since  found  an  increasing  number  of  applications  in  many 
different  areas,  especially  in  the  structural  and  aircraft  indus¬ 
tries.  For  a  bibliography  of  available  results  see  Basu  (1977) . 

In  many  situations,  the  distribution  of  X  (or  of  both  X 
and  Y  )  will  be  completely  known  except  possibly  for  a  few  unknown 
parameters  and  it  is  desired  to  obtain  parametric  solutions.  Thus, 
in  case  of  missile  flights,  the  stress  may  be  expensive  to  sample, 
but  the  physical  characteristics  of  the  missile  system,  such  as  the 
propulsive  force,  angle  of  elevation,  changes  in  atmospheric  condi¬ 
tion,  and  so  on,  may  all  have  known  distributions;  consequently, 
the  distribution  of  stresses  can  be  calculated.  Church  and  Harris 
(1970),  Owen,  Craswell  and  Hanson  (1964),  and  Govindarajulu  (1968) 
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have  considered  the  above  problem  under  the  assumption  that  X 
and  Y  have  normal  distributions.  Since  in  many  physical 
situations,  especially  in  reliability,  exponential  and  other 
distributions  provide  more  realistic  models,  it  is  desirable  to 
obtain  estimators  of  R  for  distributions  useful  in  life  test¬ 
ing.  In  section  2  we  consider  gamma  and  exponential  distribu¬ 
tions  under  the  assumption  that  X  and  Y  are  independently 
distributed.  The  case  of  a  bivariate  exponential  distribution 
is  studied  in  section  3.  Two  distribution  free  procedures  are 
mentioned  in  section  4.  The  effect  of  misspecifying  the  model 
is  considered  in  section  5  and  a  numerical  example  is  given  in 


section  6. 
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2.  Gamma  and  Exponential  Distribution. 


Let  X  and  Y  be  independently  distributed  with  density 
functions 


(2.1) 


£(x>  *  TT57  e~ax  *P”1  '  *>0  -  p>0 


(2.2) 


g(y)  “  ffqT  e_ey  yq_1  '  y>0  '  q>0 


respectively.  Then 


«pq=  P(X<Y)  .  r|/x  e-*y  y^dyj  ^ 


e-«y  yq-ldy|  e-ax  xP-ld* 


(2.3) 


q-i 


L  r(pfR!c+i> 


«PBk 


k-0 


(a+&) 


Here  p  and  q  are  assumed  to  be  known  integers. 

Note  Rn  -  a/(a+B)  ,  and  Rpl  -  for  all  p  . 


%  -  T(»/-)k  w  -t  V 


,  k+1 


k-0 


6  k-0 


Also# 
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In  particular, 

R21  "  R11  '  R31  *  Rll  ' 

R12  *  R11  + 

R13  “  Rn+  (B/oOR^  +  (B/cOR^  / 

R22  *  Rll*3  "  2R11^  * 

if  is  close  enough  to  one,  as  is  expected  for  items  with 

high  reliability, 

Rlq  =!T(1‘R11)  * 

Expressions  for  Rpl  and  indicate  that  in  this  case  the 

expression  for  the  reliability  is  not  strongly  dependent  on  the 
choice  of  the  parameter  p  (especially  if  p  is  small)  and 
the  distribution  of  x  can  be  approximated  by  the  exponential 
distribution  without  much  distortion  in  the  value  of  R 
However,  so  far  as  the  parameter  q  is  concerned,  the  situation 
is  quite  reversed.  The  value  of  reliability  is  heavily  dependent 
on  the  choice  of  the  underlying  distribution  of  Y  and  one 
has  to  choose  the  value  of  q  more  carefully.  Later  in  section 
5,  we  shall  further  study  the  effect  of  misspecifying  the  para¬ 
meters  p  and  q  and  confirm  our  conclusions  by  numerical 
studies. 

If  two  independent  random  samples  (X^Xj,..., x^)  and 

*  *  *  'Yn^  ^rom  t*1®  two  gamma  populations  are  available 

maximum  likelihood  estimators  (MLE)  j 

i 


Hence  MLB  of 


of  a  and 


is 


(2.4) 


8  are  given  by  a  =  p  and  8  «  St  . 

X  Y 


qi1  r (p  +  k)  ap8k 

k=0  r(p)T(k  +1)  (a  +  8)p+k 


As  special  cases,  if  q  =  1  ,  that  is  it  X  follows  the  gamma 
distribution  and  Y  follows  the  exponential  distribution 


(2.5) 


Finally,  if  both  p  and  q  are  equal  to  1,  we  have  the  case  of 
two  independent  exponential  distributions  and  we  have 


(2.6) 


,  _J2 _ _  * 

11  A  A  _  _  • 

a  +  8  X  +  Y 


A  V  A 

Since  R  in  (2.6)  is  a  function  of  —  ,  the  exact  distribution  R 

Y 

can  be  obtained  in  the  exponential  case.  It  is  well  known  that 

X  a  follows  the  F  distribution  with  (2m, 2n)  degrees  of 
Y  8 

freedom.  Thus  the  distribution  of  R^  follows.  The  result  will 
be  used  later  in  section  5  to  compare  the  performance  of  independent 
exponentials  with  those  of  dependent  exponential  models.  Using  a 
theorem  in  Rao  (1965,  Thm.  6a. 2,  page  321),  the  distribution  of  R 
each  of  the  above  cases,  for  large  m  and  n  ,  can  be  shown  to  be 


in 
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normal  and  hence  an  estimate  of  the  asymptotic  confidence  interval 

for  R  can  be  obtained.  Thus,  in  this  case  with  m  =  n  we  have 
_  ~  2 

for  large  n,  -  R _ )  ~  N(0,q 

pq  pq 

2 


pq)  .  Expressions  for  R^  ,  R^ 


and  ,  for  a  few  selected  values  of  p  and  q  are  given  below, 

pq 


(x  ~  y 

'll  =  £+B  '  R11  "  ' 


.2  _  2ot2e2 


'11 


(a+B) 


21 


,  a 

a+B  ' 


R21  * 


4Y2 


(X+2Y)2 


21 


r  4  q2 
_  6a  B 

(a+B)6 


a  aB  £  =  Y  2XY  2 

12  a+B  *  12  (y+2X)  ( Y+2X) 2  °12 


6a2  B4 
(a+B)6 


R22  " 


a- 


2 

2a^B 


Y2 


2XY2 


2  '  3  '  k22 

(a+B)  ^  (a+Br  ^ 


""L.  7  ^  ~  "1 
(X+Y)  (X+Y) J 


a22  =  36 (aB)4/ (a+B) 4  . 
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3.  Bivariate  Exponential  Distribution. 

Since  the  exponential  distribution  is  considered  a  useful  model 
in  life  testing  problems,  it  is  desirable  to  consider  bivariate 
analogues  of  univariate  exponential  distributions  which  will  have 
properties  similar  to  those  of  the  univariate  exponential  distribution. 
Marshall  and  Olkin  (1967)  have  proposed  a  very  important  bivariate 
exponential  distribution  (BVE) ,  which  is  given  by 

_  -A1x-X5y-A1_max(x,y) 

P (x,y)  ■  P(X>x,Y>y)  *  e  A  , 

(3.1) 

0  <  AirA2#  X12  <  «,  A1+A12>0,  A2+A12  >  0(x>0,y>0)  . 


The  BVE  arises  in  several  natural  ways  and  is  considered  a 
useful  model  in  reliability  with  appealing  properties. 

Let  (X^Y^,  i  =  1,2, ...  ,n  be  a  random  sample  from  (3.1). 

We  shall  estimate  P(X<Y)  when  (X,Y)  follows  the  BVE.  It  can  be 
readily  obtained  from  (3.1)  that 


(3.2) 


P  (X  <  Y) 


Ax  +  A2  +  X12 


Hence  R  is  estimated  by 


(3.3) 


*1  +  *2  *  *12 


where  Aj,  A2,  and  A12  are  the  maximum  likelihood  estimators  of 
X  ,  a2,  and  A12  respectively.  Various  authors  have  considered 
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maximum  likelihood  estimation  of  the  parameters  A^,  X^,  X^2  . 
However,  no  explicit  solutions  of  these  parameters  are  available. 
In  order  to  obtain  an  explicit  form  for  R  ,  we  replace  the  mle 
by  some  special  ad  hoc  estimators  called  the  " INT "  estimators  of 
Prochan  and  Sullo  (1976)  which  have  very  high  asymptotic  relative 
efficiency  compared  with  the  mle  estimators.  Let  n^  =  number  of 
pairs  such  that  X.  <  Y.  ,  n_  =  number  of  pairs  with  X.  >  Y. 

*  1  •  IX 

and  n^  =  number  of  pairs  with  X^  =  Y^  . 

The  "INT"  estimators  are  given  by 


(3.4) 


r n!  ■’ 

A 

n  A  - 

n2  " 

n 

nl+n0 

n  '  a2 

n2  +  n0 

n 

I 

i=l  1 

and 


n 

l  max (X. ,  Y. )  . 
i=l  1  1 


Proschan  and  Sullo  also  prove  the  following  theorem. 

1  * 

Theorem  (Proschan  and  Sullo) .  na  (A^  -  A.)  is  asympototically 
trivariate  normal  with  mean  0  and  dispersion  matrix  £  «  (o^) 
where,  using  the  suffix  n  to  denote  dependence  on  the  sample 


A  A 


size,  A^  *  ^l'^2'^12^  1  i  a  ^i*^2,^12^  ' 
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(3.5) 


li 
°12 
°13 
°  22 
a23 
°33 


A1(,"A1a2^11)  ' 

A1A2A12 *Ay1y2*  ' 

_A1A2A12 *A1A2Y2  + *Y1  )/<e0Yl>  ' 

^2 ^  ~ A1A2Y2  ^  ' 

_A1A2A12  *A1A2Y1  +Ay2  )//(80Y2)  ' 

A12[A  “  A06Q2(A1Y23  +  A2Y13  +  2A1A2y12y22) 1  ' 


and 


A  =  A.,  +  A„  +  A,  „  ,  Y,  -  Ax  +  A12  f 


1  n2  12 


Y2  X2  +  A12 


■  E [max (X, Y) ]  «  Y^1  + y"1  -  A  1  . 


R  is  then  estimated  by  R  =  A^|  ( +  A2  +  A^)  rather  than 
by  R  .  Since  R  is  a  totally  differential  function  of  A^  A2 


a  — .  * 

and  A12  by  Theorem  6a.2(ii)  of  Rao  (page  321),  /n(R-R)  is 

asympototically  normally  distributed  with  mean  zero  and  variance 
a2  ,  where 


(3.6) 


2 

Y2 

I* 


»! 

°11  +”4(a22  +  °33} 


-  2 


A1Y2 


(a12  +  a13) 


A1 


’23 


Thus,  from  (3.3), 
confidence  limits  for  R 


(3.4)  and  (3.6),  one  si,je<}  and  two 
can  readily  be  obtained. 


sided 
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To  check  the  adequacy  of  the  large  sample  approximation  when 
the  underlying  distribution  is  BVE,  computer  simulations  were  made. 
For  various  values  of  (X^,X2,X^2>  500  sets  of  random  samples  of 
size  n  (n  =  10,  15,  20)  from  bivariate  exponential  distributions 

A 

A 

were  obtained  and  the  empirical  distribution  of  R  was  obtained. 
Even  for  sample  size  as  low  as  10  the  exact  distribution  is  found 
to  be  well  approximated  by  the  normal  approximation.  The  situation 
imt  oves  as  the  sample  size  increases. 
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4.  Distribution  free  procedures. 

In  all  the  cases  considered  in  the  previous  section  to 
check  adequacy  of  normal  approximation,  the  value  of  R  is  rather 
small  (R  <  .75),  whereas  applications  of  interest  would  be  for 
systems  with  high  reliability  (R  >  .90).  Unfortunately  in  all 
the  cases  with  R  >  .90  considered,  the  sample  estimate  of  the 
variance  of  R  came  out  to  be  negative  or  very  close  to  zero. 

(The  situation  is  similar  to  the  problem  of  having  "negative" 
estimator  of  variances  in  analysis  of  variance  problems.) 

To  study  the  cases  for  which  R>  .90,  we  therefore  consider 
the  following  estimators  of  R  : 

For  bivariate  data,  a  rather  natural  way  to  estimate 
R  =  P(X<Y)  would  be  based  on  the  binomial  distribution.  Let  T 
be  the  number  of  cases  for  which  X  <  Y  .  Then  T  is  a  binomial 
random  variable  with  mean  R  and  variance  nR(l-R)  .  We  therefore 
can  obtain  an  exact  binomial  confidence  interval  or  an  approximate 
two  sided  100(l-y)%  confidence  interval  given  by 

(4.D  ,  R  +  ^ ' 

where  R  =  T/n  and  is  such  that  $(Z^)  =  (l-y/2)  ,  where 

$(•)  is  the  standard  normal  distribution. 

In  case  X  and  Y  are  assumed  independent,  a  second 
estimator  is  the  following  nonparametric  confidence  interval 
proposed  by  Govindarajulu  (1968)  and  is  based  on  the  Wilcoxon- 
Mann-Whitney  statistic. 
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Let  (x^Xj*  •  • .  #xm)  and  (Y^#Y2»  . . .  #Yn)  be  two  Independent 
samples  of  measurements  from  populations  with  distribution  functions 
F (x)  and  G(y)  respectively.  Let 


iMX^Yj) 


C 


if  Xi<Yj 
otherwise 


m  n 

then  U  *  7  l  iJ>(X.  #Y. )  is  the  well  known  two  sample  Mann-Whitney 

i*l  j-1  1  3 

statistic.  That  is#  U  *  number  of  pairs  (X^#Yj)  such  that  <  Y ^ 
Govindarajulu  (1968)  has  explicitly  derived  one-sided  and  two-sided 
distribution  free  confidence  bounds  for  R  (actually  Govindarajulu 
derived  confidence  bounds  for  1-R  )  based  on  the  asymptotic 
normality  of  R  =*  U/ran  .  In  particular,  for  the  two-sided  case# 
Govindarajulu  showed  that  for  all  F  and  G  and  large  m  or  n  # 
the  solution  of  the  inequality 


(4.2) 


P(|R-R|  S£y)  &  1-Y  #  0  <  Y  <  1 


is  given  by 

(4v)"V1(l- Y/2)  . 

Here  v*=roin(m#n)  and  *(•)  is  the  cdf  of  standard  normal  distri¬ 
bution.  In  particular#  if  ra  * n  #  a  100 (1-Y) %  confidence  interval 
is  given  by 

(4.3)  (R  -  e y#  R  +  ty)  # 

where  R  and  Z are  as  defined  before#  and 


e  ■  — L- 
*  2/n 
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5 .  Effect  of  misspecifying  the  model. 

In  section  2  it  was  pointed  out  that  for  values  of 
P(X  <  Y)  close  to  unity,  R  is  less  sensitive  to  the  varia- 
tion  of  p  and  varies  considerably  for  varying  values  of  q  . 

To  study  the  effect  of  misspecifying  the  model  we  carry  out  the 
following  Monte  Carlo  experiment. 

Let  G(a,p)  and  G(8,q)  be  two  given  gamma  populations 
with  known  parameters  (a,p)  and  (6,q)  respectively,  where 
a  =»  19  and  8*1.  In  this  case,  if  p  =  q  =  1  ,  *  .95  . 

By  chosing  different  pairs  (p»q)  we  get  different  pairs  of 

gamma  distributions. 

Let  (X^,X2, . . . ,XR)  and  (Y^ ,  Y2 , • • • ,  Y^)  be  two  random 

samples  from  G(a,p1)  and  G(8,q1)  .  Since  p^^  and  q^^  ,  the 

true  values  are  not  known,  there  is  a  possibility  that  we  will 

choose  a  different  pair  of  distributions  as  the  true  model.  Let 

us  assume  that  the  above  samples  have  come  from  populations  with 

distributions  G(a,p2>  and  G{8,q2)  •  Thus  we  would  estimate 

R  „  instead  of  estimating  the  true  value  R„  „  ,  and  compute 

p2q2  „  plql 

a  confidence  interval  based  on  R  „  .  We  would  not  commit  much 

p2q2 

specification  error  if  this  confidence  interval  contains  the  true 

unknown  value  R  „  .  For  a  given  n  and  two  pairs  of  values 

plql 

(pl»ql)  and  the  above  procedure  is  repeated  1000  times 

and  a  count  is  made  of  how  many  times  the  true  value  Rp  g 

contained  in  the  confidence  interval  based  on  R  .We  repeat 

p2q2 

the  procedure  for  different  values  of  n  and  different  combina¬ 
tions  of  (p^rq-j.)  and  (p2,q2)  .  The  results  are  given  in 
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Table  1.  Here  n  is  chosen  to  be  5,  10  and  25.  All  Combi¬ 
nations  of  the  following  pairs  of  values  are  chosen  for  (p1#q1) 
and  <p2,q2):  (1/1),  (1,2),  (2,1)  and  (2,2)  . 

Prom  Table  1  we  cam  make  a  number  of  conclusions.  First 
note  that  no  parametric  method  performs  well  in  all  situations. 

For  all  the  gamma  models  considered  the  procedure,  as  anticipated 
in  section  2,  is  robust  for  small  variation  in  p  .  However,  it 
is  sensitive  to  variation  in  q  .  The  nonparametric  confidence 
intervals  based  on  the  Wilcoxon-Mann-Whitney  statistic  performs 
well  in  all  cases,  however,  in  each  case  the  width  of  the  confi¬ 
dence  interval  for  an  assumed  model  is  too  large  compared  with  the 
corresponding  width  based  on  the  parametric  models.  In  each  case 
the  parametric  method  is  to  be  preferred,  especially  if  the  para¬ 
meter  q  is  reasonably  well  specified. 


ASSUMED  MODEL 
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TABLE  1 

Number  of  counts  for  N  -  5 


TRUE  MODEL 

6(1,1)  = 
Exponential 

6(2,1) 

6(1,2) 

6(2,2) 

Rplql 

.95 

.9025 

.9975 

.99275 

G(l,l) 

exact 

933 

967 

46 

77 

6(1,1) 

normal 

approx 

855 

934 

1000 

1000 

G(2.1) 

763 

819 

66 

94 

6(1,2) 

287 

487 

828 

938 

6(2,2) 

209 

371 

725 

871 

*NP  pr 

998 

991 

1000 

1000 

•Nonparametric  Procedure 


ASSUMED  MODEL 


L6 


G(2,l) 


G<1,2) 


G(2,2) 


TABLE  1  (continued) 

Number  of  counts  for  N  «  10 


Plql 


G<1,1) 

exact 


G(lf  1) 
normal 
approx 


TRUE  MODEL 

G (1, 1)  = 
Exponential 

G(2,l) 

G(l,2) 

G(2,2) 

.95 

.9025 

.9975 

.99275 

947 

976 

0 

2 

913 

952 

188 

348 

*NP  pr 


1000 


*Nonparametric  Procedure 


ASSUMED  MODEL 
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TABLE  1  (continued) 


Number 

of  counts  for  N 

*  25 

TRUE  MODEL 

G (1, 1)  = 
Exponential 

G (2,1) 

G(l,2) 

G(2,2) 

Vi 

.95 

.9025 

.9975 

.99275 

G (1 , 1) 
exact 

945 

964 

0 

0 

*4 

W 

a 

o 

s 

G(l,l) 

normal 

approx 

934 

964 

0 

0 

a 

1 

W 

9 

G(2,l) 

768 

812 

0 

0 

G(l,2) 

6 

82 

925 

982 

G(2,2) 

1 

27 

754 

928 

*NP  pr 

1000 

998 

1000 

999 

*Nonparametric  Procedure 
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6.  An  Example. 

To  illustrate  the  computation  of  confidence  intervals  let 
us  consider  the  following  example.  Fifteen  items  of  random 
strengths  Yir...,Y15  are  subject  to  random  stresses  Xj^X-,...,: 
To  estimate  the  reliability  function  P(X  <  Y)  random  samples  of 
15  pairs  of  (X,Y)  values  are  drawn  and  given  below. 

Pair  No. 


1 

.0352 

1.7700 

2 

.0397 

.9457 

3 

.0677 

1.8985 

4 

.0233 

2.6121 

5 

.0873 

1.0929 

6 

.1156 

.0362 

7 

.0286 

1.0615 

8 

.0200 

2.3895 

3 

.0793 

.0982 

10 

.0072 

.7971 

11 

.0245 

.8316 

12 

.0251 

3.2304 

13 

.0469 

.4373 

14 

.0838 

2.5648 

15 

.0796 

.6377 

From  oast  record  it  is  known  that  R  *  .95  .  Estimates  of  R_  „ 

plql 

and  corresponding  confidence  interval  will  depend  on  the  model 
chosen  and  the  method  used  to  compute  the  confidence  interval. 

Thus  if  X  and  Y  are  assumed  independent,  we  have  two  indepen¬ 
dent  samples  of  size  15  each.  Table  2  lists  the  values  of 

*L  ~  And  confidence  interval  for  the  cases  considered  in  section 
p2q2 

5  .  We  also  use  the  notation  of  section  5  for  convenience. 

Let  us  illustrate  the  calculation  for  a  couple  of  cases.  r' 
From  the  above  data  we  have  X  ■  .0509  and  7  -  1.3602.  If  we 


15  * 
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assume  p2  =  q2  «  1  we  have,  using  results  in  section  2  , 

Rn  ■  ~  _  *  .9639 

■LA  X  +  Y 

and  corresponding  95%  confidence  interval  for  R^  ,  using  normal 
approximation,  is  (.9300,  .9978)  . 

On  the  other  hand,  if  we  used  the  exact  distribution  of  r 
we  can  obtain  the  required  confidence  interval  from  an  F-table 

y  Q 

since  U  =  —  —  follows  the  F-distribution  with  (2n,2n)  degrees 

X  a 

of  freedom  we  obtain,  after  some  simplification  (.9280,  .9823) 
as  the  required  95%  confidence  interval. 

From  Table  2  it  seems  any  of  the  first  three  procedures  based 
on  two  independent  exponential  distributions  or  G(2,l) (x  gamma 
with  shape  parameter  p  »  2  and  Y  independent  exponential)  will  be 
quite  satisfactory. 


TABLE  2 


Comparison  of  Various  Confidence  Intervals 
and  Estimates  of  R 


Model  Used 

A 

R 

Confidence  Interval 

G  (1 , 1)  exact 

.9639 

(.9280, .9823) 

G(l,l)  normal  approximation 

.9639 

(.9300, .9978) 

G  (2 , 1) 

.9639 

(.9416, .9856) 

G(l,2) 

.9952 

(.9896,1.000*) 

G (2 , 2) 

.9962 

(.9925, .9999) 

Binomial  Procedure 

.9333 

(.8071,1.000*) 

NP  Procedure 

.9600 

(.7070,1.000*) 

* 


Computed  as  being  larger  than  1 
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